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EXECUTIVE  SUMMARY 


This  report  documents  an  explanatory  effort  to  uncover  and  document  human  factors  issues  in 
the  design  of  Instrument  Approach  Charts,  sometimes  referred  to  as  Instrument  Approach 
Plates  (lAP's).  The  effort  consisted  of  literature  review,  pilot  opinion  survey,  data  analysis, 
and  interview  components.  The  analysis  included  data  from  the  National  Transportation 
Safety  Board,  Federal  Aviation  Administration,  Aviation  Safety  Reporting  System,  and 
National  Oceanic  and  Atmospheric  Administration.  A  small  pilot  opinion  survey  on  patterns 
of  lAP  use  was  conducted  by  MIT.  Prior  lAP  surveys  were  also  analyzed.  Focused 
interviews  were  conducted  with  training  centers,  operators,  cartographic  agencies,  and 
equipment  manufacturers.  Because  of  the  exploratory  nature  of  this  effort,  the  findings 
reported  in  this  document  warrant  further  investigation  and  should  not  be  considered  as 
neeessarily  representative  of  any  lAP  user  group.  The  investigations  resulted  in  the  following 
findings: 

1.  Current  lAP's  are  the  result  of  a  mature  evolutionary  process  driven  by  user  feedback, 
concern  over  flight  safety,  and  the  liability  of  the  charting  agencies.  Even  though  the 
charts  have  evolved  in  the  absence  of  formal  human  factors  analysis,  major  changes  in 
format  for  paper  approach  charts  does  not  appear  to  be  indicated. 

2.  Current  lAP's  represent  a  balance  between  different  chart  design  tradeoffs.  Fundamental 
tradeoffs  were  identified  in  the  areas  of:  chart  size  versus  legibility,  information  content 
versus  clutter,  and  cost  tradeoffs. 

3.  Concern  over  “controlled  flight  into  terrain”  accidents  has  motivated  an  increased  interest 
in  terrain  information  on  the  lAP's.  The  current  technique  of  presenting  terrain 
information  through  spot  elevations  is  considered  ineffective  and  contributes  to  chart 
clutter.  Smoothed  contours  have  been  used  effectively  to  portray  terrain  information. 
However,  the  resulting  increase  in  data  monitoring,  chart  revision,  and  production  costs 
has  contributed  to  preventing  full  implementation  by  US  chart  producers. 
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4.  Several  problems  were  identified  relating  to  the  currency  of  information  available  to  the 
flight  crews  both  on  the  lAP's  and  through  Notices  to  Airmen  (NOTAMS). 

5.  Significant  differences  in  lAP  operational-use  patterns  were  observed  between  user 
groups;  particularly,  between  multi-crew  air  carrier  operations  and  single  pilot  general 
aviation  operations.  Cost  factors  preclude  lAP  designs  focused  for  speeific  user  groups. 

6.  Some  evidence  was  found  that  switching  between  lAP  formats  redueed  the  effectiveness 
of  information  transfer  from  the  charts.  This  argues  that  a  significant  performance  or 
safety  improvement  should  be  expected  before  major  format  changes  are  implemented.  In 
addition,  formal  human  factors  review  of  proposed  changes  would  help  quantify  the 
potential  improvements. 

7.  In  the  MIT  survey,  93%  of  the  pilots  felt  that  it  was  possible  to  make  operational  errors 
due  to  chart  design.  Several  potential  operational  errors  were  identified  including; 
confusion  between  primary  and  secondary  navaid  frequencies,  confusion  on  approach 
minimums,  missing  chart  notes,  confusion  on  minimum  safe  altitudes,  complexity  of  the 
proeedures,  location  of  runway  lighting  information,  and  awareness  of  dual  use  common 
ILS  frequencies. 

8.  The  potential  of  eleetronic  lAP's  offers  the  opportunity  for  more  flexibility  in  the 
presentation  of  approach  information.  However,  concerns  about  system  reliability,  data 
integrity,  and  strueture  and  crew  workload  have  emerged.  It  is  generally  agreed  that 
electronically  based  lAP's  will  emerge  within  the  next  five  years  and  it  is  important  to 
reeonsider  the  lAP  human  factors  issues  in  light  of  the  flexibility,  capability,  and 
limitations  of  the  electronic  systems. 
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1.  INTRODUCTION 


The  1985  FAA  Human  Factors  Research  Plan'  identified  chart  design  as  one  of  the  cockpit- 
related  human  performance  problem  areas  which  should  be  addressed  through  human  factors 
research.  Instrument  Approach  Charts,  also  referred  to  in  this  report  as  Instrument  Approach 
Plates  or  lAP's,  were  chosen  for  initial  human  factors  review  over  other  chart  types  such  as 
En  Route  or  Sectional  Charts  for  two  primary  reasons.  First,  the  lAP's  depict  the  Terminal 
Arrival  and  Missed  Approach  Procedures  which  occur  at  low  levels  with  minimal  terrain 
clearance  and  consequently  low  tolerance  for  procedural  errors.  Secondly,  the  lAP's  often 
have  a  high  level  of  procedural  and  cartographic  complexity,  making  careful  human 
engineering  critical. 

This  report  documents  an  effort  to  identify  specific  areas  where  improved  human  engineering 
of  the  design  or  use  of  lAP's  could  yield  improvements  in  performance  or  flight  safety.  The 
work  was  conducted  under  Department  of  Transportation/Transportation  Systems  Center 
contract  DTRS-57-88-C-00078.  In  the  report,  the  procedures  used  to  query  the  various 
information  sources  are  described  in  Section  2.  The  findings  are  presented  and  discussed  in 
Section  3. 


2.  APPROACH 


The  approach  consisted  of  a  broadly  based  analysis  and  review  of  information  sources  likely 
to  yield  insight  into  potential  operational  errors  related  to  lAP  usage.  In  addition,  pilot 
preferences  were  solicited  to  allow  identification  of  areas  where  user-centered  design 
principles  could  be  productively  applied  to  lAP  use  or  design. 

The  information  sources  used  included  a  broadly  based  literature  review,  analysis  of  relevant 
data  sources,  and  the  analysis  of  several  pilot  opinion  surveys.  In  addition,  focused 
interviews  were  conducted  to  get  input  from  both  the  operational  and  chart  production 
communities.  A  brief  description  of  the  procedure  used  for  each  of  the  information  source 
types  is  presented  below. 

2.1  LITERATURE  REVIEW 

A  broadly  based  literature  review  was  condueted.  In  addition  to  reviewing  the  aviation 
human  faetors  literature,  such  as  Human  Factors  in  Aviation^  edited  by  Weiner  and  Nagel, 
and  Flightdeck  Performance^  by  O’Hare  and  Roscoe,  the  Proceedings  of  the  Five  Symposiums 
on  Aviation  Psychology"^  and  speeific  reports  on  charting  human  factors  such  as  the  Report  of 
Safety  Survey  Human  Integration  of  Approach  Charts^  were  also  reviewed.  Aircrew  training 
material  was  also  reviewed  including  the  FAA  Instrument  Flying  Handbook  (AC-6 1-270),'^  the 
Jeppesen-Sanderson  Flight  Time  video  training  tape  Jeppesen  Approach  Charts,''  the  NOAA 
Aeronautical  Chart  Users  Guide,^  as  well  as  a  self-study  guide  for  a  major  U.S.  air  carrier. 

The  regulatory  and  eartographie  literature  were  also  reviewed.  This  ineluded  the  Terminal 
Instrument  Procedures  (TERPS)"  which  define  the  criteria  for  instrument  approach  procedures 
in  the  U.S.,  the  Federal  Aviation  Regulations, the  Airman's  Information  Manual,"  the  ICAO 
Instrument  Approach  Chart  Guidance  to  Chart  Makers  (Circular  187-AN/114),‘^  the  FAA 
Instrument  Procedures  Automaton  Users  Manual,'^  and  Instrument  Approach  Procedures  from 
Request  to  Publication.'* 
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Finally  the  last  three  years  of  aviation  periodicals  were  reviewed  including  IFR  Refresher, 
AOPA  Pilot,  Aviation  Week  and  Space  Technology,  Airline  Pilot,  Flying,  and  Professional 
Pilot. 

2.2  ANALYSIS  OF  RELEVANT  DATA 

A  review  and  analysis  of  available  data  relevant  to  lAP -related  operational  errors  and  pilot 
preferences  was  conducted. 

2.2.1  Accident/Incident  Data 

In  order  to  identify  accident  statistics  related  to  lAP  usage,  an  attempt  was  made  to  filter  the 
FAA  Accident/Incident  Database  for  lAP -related  accidents  or  incidents.  This  database  is 
generated  from  the  FAA  and  NTSB  investigations  of  accident  and  incident  events.  It  consists 
of  a  broad  range  of  data  fields  and  a  short  narrative  summary  of  the  event. This  effort  was 
hampered  by  the  lack  of  charting-related  cause  factors  in  the  data  fields.’^  The  most  relevant 
listing  of  lAP-related  accidents  was  found  in  an  August  18,  1982  letter  from  NTSB  Chairman 
Jim  Burnett  to  FAA  Administrator  J.  Lynn  Helms,  which  discussed  the  “belief  that 
insufficient  attention  is  given  to  human  performance  criteria  in  the  development  of  approach 
procedures  and  in  the  process  for  reviewing  the  approach  procedure  depicted  on  the  approach 
charts.”  The  letter,  which  is  included  as  Appendix  A,  also  summarized  nine  fatal  accidents 
involving  the  design  of  approach  charts  or  approach  procedures  between  1971  and  1981. 

2.2.2  Operational  Error  Data 

The  FAA  Operational  Error  Database  (which  is  similar  to  the  Accident/Incident  Database) 
was  reviewed  for  a  one-year  period  starting  in  1987.  In  general,  the  database  focused  on 
controller  errors;  consequently,  little  information  relevant  to  this  study  was  found. 
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2.2.3  Aviation  Safety  Reporting  System  (ASRS)  Data 


The  Aviation  Safety  Reporting  System  (ASRS)  data  set  was  scanned  for  reports  related  to 
charting  issues  between  January  1,  1983  and  November  8,  1988.  The  ASRS  is  a  program  in 
which  pilots  and  controllers  are  encouraged  to  report  safety-related  issues  and  errors  with 
some  degree  of  immunity  and  anonymity.  A  total  of  86  reports  were  identified  and  analyzed 
further.  Of  these,  42  were  found  to  be  related  to  lAP  use.  These  reports  were  summarized, 
categorized,  and  evaluated  in  order  to  identify  common  patterns  or  particularly  serious 
problems. 

2.2.4  NOAA  Callback  Comments 

In  an  effort  to  minimize  and  respond  to  charting  errors,  or  to  answer  questions  of  an 
interpretational  nature,  NOAA,  which  is  the  government  producer  of  civil  lAP's,  provides  a 
toll-free  800  number  for  users  to  call  with  chart  errors  or  problems  in  chart  interpretation. 
These  calls  are  logged  and  appropriate  actions  are  tracked.  The  NOAA  callback  comments 
are  a  valuable  data  set  in  that  they  represent  a  cross-section  of  errors  and  problems  in 
interpretation  encountered  by  the  users.  NOAA  provided  the  investigators  with  237  callback 
comment  log  sheets  representing  a  24-month  period.  The  sheets  contained  259  comments 
which  were  evaluated.  The  evaluation  consisted  of  a  review  of  the  comments  and  a 
categorization  into  one  of  1 1  comment  categories. 

2.3  Pilot  Opinion  Survey  Data 

Data  were  analyzed  from  several  relevant  pilot  opinion  surveys  described  below. 

2.3.1  MIT  Survey 

As  part  of  the  overall  effort  on  the  design  and  evaluation  of  aeronautical  charts,  300  copies  of 
an  extensive  survey  on  approach  chart  information  analysis  were  distributed  to  lAP  users 
representing  a  full  spectrum  of  operators  from  general  aviation  to  air  carrier.  When  this 
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report  was  first  written,  29  responses  had  been  received  and  analyzed.  The  low  response  rate 
(9.7%)  is  thought  to  be  due  to  the  extensive  nature  of  the  survey.  The  respondents  are 
therefore,  self-selected  and  may  not  be  fully  representative  of  the  user  population.  A  copy  of 
the  relevant  sections  of  the  survey  are  presented  in  Appendix  B. 

2.3.2  Aviation  Systems  Concepts.  Inc.  Survey 

In  1987,  the  FAA  published  the  results  of  a  pilot  opinion  survey  conducted  by  Aviation 
Systems  Concepts,  Inc.  for  the  Air  Force  and  the  FAA.^  The  survey  consisted  of  a  30-item 
Yes/No  response  questionnaire  and  a  topical  workload  questionnaire  designed  to  evaluate  the 
problems  in  instrument  approach  plate  design.  A  total  of  1,037  pilots  associated  with  U.S. 

Air  Force  and/or  civil  flight  operations  responded  to  the  survey.  In  the  following  discussions, 
this  will  be  referred  to  as  the  ASC  survey. 

2.3.3  ALFA  Survey  Data 

In  1988,  the  Air  Line  Pilots  Association  conducted  a  survey  of  pilot  opinions  concerning  a 
new  approach  chart  format  which  included  color  contours  for  terrain  depiction.  It  also 
included  larger  and  bolder  print  sizes  for  improved  readability  of  critical  information,  a  new 
landing  minimums  format,  and  additional  runway  landing  length  information.  The  survey  was 
conducted  through  postcard  responses  to  example  charts  published  in  Airline  Pilot}^  There 
were  1377  respondents  to  the  survey  and  the  results  strongly  supported  the  new  format 
(greater  than  90%).  While  the  survey  was  not  controlled  for  objectivity,  the  results  do 
indicate  a  strong  concern  on  the  part  of  line  pilots  for  improved  readability,  more  terrain 
information,  and  improved  minimums  and  runway  length  presentation. 

2.4  Interviews 

In  order  to  further  identify  common  operational  errors  or  pilot  preferences  which  did  not 
emerge  from  the  sources  cited  above,  a  series  of  focused  interviews  were  conducted  with 
representatives  of  various  groups  involved  with  lAP  production  and  use.  These  included 
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training  centers,  operators,  cartographic  agencies,  and  equipment  manufacturers.  Unless 
noted,  the  interviews  were  eonducted  from  a  directed  question  list  (Appendix  C).  In  addition, 
related  comments  and  observations  by  the  interviewees  were  solicited. 

It  should  be  noted  that  it  was  decided  to  interview  a  limited  number  of  individuals  from  a 
broad  range  of  groups  in  order  to  obtain  input  from  a  wide  range  of  lAP  experienee.  As  a 
consequenee,  the  responses  from  any  individual  group  may  not  be  fully  representative. 
However  it  was  felt  that  this  method  obtained  the  broadest  possible  exposure  within  the  scope 
of  this  effort. 

2.4.1  Training  Centers 

Training  Centers  were  chosen  as  prime  interview  sources  because  it  was  hypothesized  that 
difficulties  with  lAP  use  would  be  most  apparent  in  the  training  environment  where  the  user 
(i.e.,  the  student)  tends  to  exhibit  a  higher  frequency  of  operational  errors  as  a  result  of 
training  stress  and  praetice  in  abnormal  or  emergency  situations.  In  addition,  the  instructor 
has  the  opportunity  to  observe  and  critique  those  operational  errors  which  do  occur. 

Representing  professional  pilot  training,  the  Manager  of  Flight  Training  and  the  Senior  Check 
Airman  from  two  major  air  carriers  were  interviewed.  Similarly,  the  Senior  Instruetors  and 
Examiners  at  two  Training  Centers  which  primarily  train  corporate  and  Part  135  operators 
were  interviewed.  Finally,  four  Certified  Instrument  Flight  Instructors  (CFI-I)  who  provided 
initial  instrument  flight  instruction  to  relatively  low  time  (100  to  400  hour)  non-professional 
pilots  in  single  engine  aireraft  were  interviewed,  representing  non-professional  training 
operations.  At  the  request  of  several  of  the  organizations,  the  names  and  affiliations  of  the 
individuals  interviewed  are  withheld  in  the  report. 

2.4.2  Operators 

Informal  interviews  were  conducted  with  a  variety  of  pilots  currently  flying  aircraft  ranging 
from  general  aviation  to  fully  autoflight-equipped  air  transport  aircraft.  The  interviews  often 
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occurred  during  jump  seat  observations  of  lAP  use  patterns.  When  possible,  they  followed 
the  focused  interview  format  (Appendix  C).  In  addition,  a  representative  from  the  Airline 
Pilots  Association's  (ALPA)  Charting  and  Instrument  Procedures  Committee  was  interviewed. 

2.4.3  Cartographic  A2encies 

In  an  effort  to  identify  the  issues  perceived  as  important  by  the  agencies  and  organizations 
which  are  involved  in  the  production  of  LAP's,  a  set  of  focused  interviews  was  conducted  with 
representatives  from  these  groups.  The  interview  procedure  was  similar  to  that  used  for  the 
Training  Centers,  however,  the  scope  and  direction  of  the  interviews  was  modified  to  reflect 
the  issues  relevant  to  the  cartographic  groups. 

Within  the  continental  U.S.,  the  primary  providers  of  lAP's  are  Jeppesen  Sanderson,  Inc.,  and 
the  U.S.  government  (NOAA  and  DOD  in  cooperation  with  the  FAA).  Representing  NOAA, 
the  Chief  of  the  Instrument  Approach  Division  was  interviewed.  The  Chief  was  extremely 
cooperative  and  provided  all  requested  data  including  the  “Callback”  comments  for  the 
proceeding  two-year  period.  Representing  Jeppesen  Sanderson,  Inc.,  the  Vice  President  for 
Research,  Development  and  Production  and  the  Director  of  Flight  Information  Design  and 
Research  were  interviewed  on  two  separate  occasions.  They  were  also  extremely  cooperative 
and  supportive  of  the  effort.  In  the  following  discussions,  Jeppesen  Sanderson,  Inc.  charts 
will  simply  be  referred  to  as  Jeppesen,  and  U.S.  Government  charts  will  be  referred  to  as 
NOAA  charts. 

The  FAA  representative  to  the  Interagency  Cartographic  Committee  which  sets  the 
cartographic  standards  for  the  NOAA  and  DOD  charts  was  also  interviewed  as  well  as  a 
flight  surgeon  for  the  FAA  Office  of  Aviation  Medicine  who  reviews  chart  modifications. 

For  comparison,  a  non-U.S.  based  operator  and  chart  provider  (KLM)  was  contacted  by  mail 
and  the  Head  of  the  Navigation  and  Documentation  Department  responded  with  written 
comments  and  examples  of  KLM  approach  chart  formats. 
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2.4.4  Equipment  Manufacturers 


To  gain  further  insight  into  current  and  future  lAP  use,  representatives  from  several 
equipment  manufacturers  were  interviewed.  These  interviews  were  generally  informal  since 
the  focused  interview  formats  were  not  directly  applicable.  Representing  airframe 
manufacturers,  individuals  were  interviewed  from  several  organizations  within  the  Boeing 
Commercial  Airplane  Company  including  Flight  Deck  Research  and  several  product  groups. 
Representing  manufacturers  of  Electronic  Flight  Information  Systems  (EFIS)  and  flight  data 
systems,  interviews  were  conducted  with  several  individuals  at  Honeywell  Inc.,  and  Sperry 
Commercial  Flight  Systems  Group.  Finally,  the  President  of  Lasertrack,  which  manufactures 
and  supports  a  printer-based  electronic  lAP  system,  was  interviewed. 
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3.  DISCUSSION  AND  FINDINGS 


In  order  to  provide  a  coherent  presentation,  the  findings  of  the  above  review,  survey,  analysis, 
and  interview  effort  were  combined  and  organized  into  the  six  separate  topical  areas  discussed 
below. 

3.1  FACTORS  INFLUENCING  CHART  EVOLUTION 

While  there  are  significant  variations  in  detail,  the  overall  format  of  most  lAP's  used  in  the 
western  world  are  similar  and  generally  fall  within  the  guidelines  recommended  by  the 
International  Civil  Aviation  Organization  (ICAO)  Circular  187-AN/114.  This  can  be  seen  by 
comparing  the  ICAO  format  shown  in  Figure  1  with  examples  of  charts  from  NO  A  A, 
Jeppesen,  KLM,  and  the  French  Service  de  I'lnformation  Aeronautique  shown  in  Figures  2 
through  5. 

For  the  US  charts  (NOAA  and  Jeppesen),  the  detailed  format  and  design  of  the  charts  is 
considered  to  be  the  result  of  a  mature  evolutionary  process.  This  process  is  driven  by  safety, 
legal,  and  market  factors.  When  charting  problems  which  clearly  impact  flight  safety  are 
identified,  the  charts  are  normally  changed  at  the  first  possible  opportunity.  This  can  be  seen 
in  the  response  to  the  NTSB  recommendations  presented  in  Appendix  A.  At  least  six  chart 
changes  are  a  result  of  the  nine  accidents  identified  in  the  report. 

Additionally,  both  NOAA  and  Jeppesen  have  programs  which  solicit  user  feedback  to  identify 
specific  chart  errors  or  general  recommendations  for  improvement  in  chart  design.  This  is 
done  both  for  safety  and  for  product  improvement  reasons,  and  is  particularly  tme  of 
Jeppesen  which  is  extremely  market-oriented  in  its  chart  design.  NOAA  uses  a  toll-free  800 
telephone  line  to  solicit  user  comments  while  Jeppesen  uses  a  pre-paid  postcard.  Both  NOAA 
and  Jeppesen  report  that  they  carefully  review  all  user  inputs.  This  was  confirmed  for  NOAA 
by  reviewing  two  years  of  callback  comment  log  sheets.  Of  the  259  comments,  all  were 
tracked  to  resolution  by  the  NOAA  staff.  Jeppesen  provided  examples  of  similar  response  to 
user  comments.  In  general,  it  was  observed  that  these  feedback  mechanisms  provided  a 
strong  positive  mechanism  for  chart  evolution. 
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FORMAT  -  INSTRUMENT  APPROACH  CHART- ICAO 


FIGURE  1.  EXAMPLE  OF  ICAO  INSTRUMENT  APPROACH  PLATE  FORMAT 
TAKEN  FROM  ICAO  CIRCULAR  187- AN/1 14  [12] 
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AlP  -  FRANCE  SERVICES  D'lFFORMATION  AERONAOTIQUE 


Concern  about  potential  litigation  is  also  considered  to  have  a  major  impact  on  chart 
evolution  with  both  positive  and  negative  aspects.  On  the  positive  side,  litigation  motivates  a 
desire  for  accuracy  in  the  information  provided  on  the  charts.  Jeppesen,  in  particular,  takes 
great  care  in  corroborating  the  data  it  uses  to  produce  the  charts.  On  the  negative  side,  fear 
of  litigation  makes  it  difficult  to  remove  marginally  useful  information  from  the  charts 
tending  to  increase  chart  clutter. 

As  an  example,  on  both  the  NOAA  and  Jeppesen  charts,  terrain  information  is  primarily 
displayed  by  point  elevation  symbols  such  as  the  one  shown  in  Figure  6.  This  presentation  is 
generally  considered  to  be  ineffectual  (e.g.,  ICAO  Circular  187-AW/114  recommends 
replacing  spot  elevations;  85%  of  the  respondents  to  the  MIT  survey  wanted  the  spot 
elevation  information  reduced  or  removed).  This  is  because  the  information  is  only  used  in 
an  emergency  situation  where  there  is  insufficient  time  to  carefully  review  the  detailed  spot 
elevations.  During  the  interview  effort,  the  FAA  representative  to  the  Interagency 
Cartographic  Committee  admitted  the  marginal  utility  of  the  spot  elevation  depiction  but 
stated  that  the  spot  elevations  were  kept  on  the  charts  because  of  concern  about  liability 
exposure  if  the  spot  elevations  were  removed,  and  an  aircraft  was  to  impact  that  obstruction. 


FIGURE  6.  EXAMPLE  OF  A  SPOT  ELEVATION  SYMBOL 

In  the  cartographic  interviews,  it  was  noted  that  lAP  evolution  has  occurred  essentially  in  the 
absence  of  any  formal  human  factors  review.  Major  changes  may  be  sent  to  user  groups  or 
the  Office  of  Aviation  Medicine  for  comment,  but  the  changes  are  basically  driven  by  the 
best  cartographic  judgment  of  the  charting  agencies. 
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3.2  CHART  DESIGN  TRADEOFFS 


The  detailed  design  of  lAP  formats  represents  the  cartographic  balance  of  natural  tradeoffs 
which  are  implicit  in  lAP  design.  The  variability  in  the  lAP  examples  shown  in  Figures  2 
through  5  results  from  the  different  balances  chosen  by  each  cartographic  agency  as  a  result 
of  their  design  philosophy  and  the  evolutionary  factors  discussed  in  Section  3.1.  Several  key 
tradeoffs  in  chart  design  are  discussed  below. 

3.2.1  Chart  Size  Versus  Le£ibilitv 

One  of  the  fundamental  tradeoffs  in  TAP  design  is  the  balance  between  the  size  of  the  chart 
and  the  legibility  of  the  print.  Most  lAP's  are  produced  on  small  size  paper  (5  x  8.5  in.). 

The  small  size  of  the  chart  forces  the  textual  print  also  to  be  quite  small.  Print  size  for  most 
information  is  from  5  to  9  points  on  the  NOAA  and  Jeppesen  charts. 

The  small  print  size  was  widely  recognized  in  the  literature  and  supported  by  the  surveys  and 
interviews  to  be  an  impediment  to  the  use  of  the  chart.^’’*  This  situation  is  particularly  true 
during  night  operations  where  cockpit  lighting  may  be  suboptimal,  in  turbulent  conditions,  or 
for  older  pilots  where  rapid  mid-field  (instrument  panel)  to  near-field  (chart)  visual 
accommodation  is  difficult.  KLM  conducted  a  study  of  their  lAP  designs  and  elected  to 
increase  the  size  of  their  LAP's  to  8.5  x  11  in.  (see  Figure  4). 

While  the  limitations  of  small  print  size  are  well  understood,  most  LAP's  are  produced  in  the 
small  5  X  8.5  in.  format.  There  are  two  primary  reasons  for  this.  First  is  the  limitation  in 
cockpit  space  available  for  the  chart.  Because  it  is  desirable  for  the  lAP  to  be  available  for 
quick  reference  during  the  approach,  it  has  become  common  practice  to  mount  the  lAP  either 
on  a  knee  pad,  in  the  center  of  the  control  yoke,  or  on  the  periphery  of  the  instrument  panel 
during  the  approach.  The  5  x  8.5  in.  format  is  the  largest  standard  paper  size  which  can  be 
conveniently  mounted  on  a  knee  pad  or  a  yoke. 
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For  the  KLM  larger  format  lAP,  the  standard  procedure  is  to  position  the  lAP's  on  the  map 
case  which  is  normally  to  the  left  of  the  Captain  and  the  right  of  the  First  Officer  on  most 
transport  category  aircraft.  It  is  interesting  to  note  that  since  this  position  is  roughly  twice  as 
far  from  the  pilot's  eyes  as  the  yoke  position,  the  print  actually  subtends  approximately  the 
same  or  less  angular  resolution  as  a  smaller  lAP  on  the  yoke.  However,  the  larger  format 
clearly  has  higher  resolution  when  brought  closer  for  careful  inspection. 

A  secondary  practical  factor  which  limits  chart  size  is  related  to  weight  and  volume 
limitations.  It  is  common  practice  for  most  U.S.  airlines  to  carry  two  full  sets  of  lAPs  for 
the  entire  domestic  or  international  route  structure  including  all  potential  alternates.  General 
aviation  operators  may  only  carry  one  set  of  lAP's  for  a  limited  geographical  area,  but  have 
more  restrictive  weight  and  volume  constraints.  Increasing  the  chart  size  would  increase  the 
performance  penalty  for  carrying  additional  lAP's,  thereby  creating  pressure  to  reduce  the 
number  of  alternate  lAP's  available  for  emergency  diversion. 

In  the  absence  of  increasing  the  chart  size,  it  is  possible  to  simply  increase  the  print  size  as 
recommended  by  ALPA.'®  However,  if  the  information  content  of  the  charts  remains  the 
same,  this  will  result  in  chart  clutter.  Current  charts  represent  a  balance  of  print  size  and 
chart  clutter  at  the  current  information  levels.  Further  discussion  of  information  content  is 
found  in  the  next  section.  Some  work  has  been  done  to  increase  the  legibility  at  current  print 
size  levels.  Jeppesen  has  designed  a  special  font  for  lAP  use  which  attempts  to  minimize 
interpretation  errors.  There  is  also  active  research  in  this  area  within  the  Department  of 
Transportation. 

3.2.2  Information  Content  Versus  Chart  Clutter 

Because  of  the  chart  size  limitations  discussed  above,  there  is  a  natural  design  tension 
between  information  content  and  chart  clutter.  The  primary  variable  in  lAP  information 
content  is  the  amount  of  terrain  information  provided.  The  issue  of  the  appropriate  balance  of 
terrain  information  has  received  much  debate  in  recent  years  as  a  result  of  concern,  voiced  in 
several  of  the  interviews,  over  several  “controlled  flight  into  terrain  accidents.”  Pilot  opinion 
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in  this  area  varies.  For  example,  the  ALFA  survey  indicated  a  high  preference  (97%)  for 
terrain  information  enhanced  by  smoothed  color  contours  over  spot  elevations  as  shown  in 
Figure  7. 

Conversely,  77%  of  the  Jeppesen  and  71%  of  the  NOAA  civil  users  in  the  ASC  survey  felt 
that  there  are  sufficient  terrain  and  obstruction  features  displayed.  The  MIT  survey  found  that 
85%  of  their  respondents  wanted  some  terrain  information  removed. 

The  reasons  behind  the  diverse  views  on  terrain  information  were  explored  during  the 
interview  effort  and  appear  to  be  related  to  differences  in  operational  patterns,  environment, 
and  presentation.  For  example,  during  normal  IFR  domestic  U.S.  operations  from  major 
airports  where  there  is  good  radar  and  radio  navigation  coverage,  there  is  considered  to  be 
little  need  for  terrain  information.  Basically,  if  the  procedure  is  flown  correctly,  terrain 
separation  is  assured  by  the  TERPS®  criteria.  However,  the  lAP's  are  commonly  used  for 
visual  approaches  where  terrain  separation  becomes  the  responsibility  of  the  pilot.  Because 
the  visual  approaches  may  not  remain  within  the  TERRS  protected  airspace,  terrain 
information  becomes  important.  This  is  a  common  occurrence  in  Third  World  and  general 
aviation  operations  where  limited  radar  and  radio  facilities  may  be  available,  and  is 
considered  extremely  important  in  regions  with  precipitous  terrain. 

Terrain  information  is  also  considered  important  for  abnormal  operations  such  as  particular 
full  power  loss  where  the  aircraft  may  not  be  able  to  maintain  the  Minimum  Safe  Altitude 
(MSA).  Finally,  terrain  information  is  considered  important  during  nonstandard  missed 
approach  or  vectoring  procedures  as  a  check  against  controller  error,  because  the  ATC 
Minimum  Vectoring  Altitudes  (MVA)  are  lower  than  the  MSA's  provided  on  the  lAP's. 

Some  of  the  difference  in  pilot  opinion  as  to  the  importance  of  terrain  information  appears  to 
be  due  to  the  manner  in  which  it  is  presented.  In  general,  there  is  support  for  increased 
presentations  of  terrain  using  smoothed  contours,  particularly  in  mountain  regions,  and  less 
support  for  the  spot  elevations.  ICAO'-  has  taken  this  position  and  cartographic  agencies  have 
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already  begun  to  respond.  For  example,  smoothed  contours  can  be  seen  on  the  French  lAP 
(Figure  5)  and  are  being  implemented  in  limited  cases  by  Jeppesen. 


3.2.3  Cost  Tradeoffs 

Cost  tradeoffs  are  also  major  factors  in  influencing  chart  design;  both  NOAA  and  Jeppesen 
cited  cost  factors  in  discussing  format  design.  For  example,  the  smoothed  contour 
representation  of  terrain  information  discussed  above  is  most  effective  when  presented  in 
color"’  but  this  adds  significantly  to  the  cost  of  chart  production.  Perhaps  more  important 
than  the  costs  of  production  arc  the  costs  associated  with  maintaining  the  integrity  of  the 
underlying  terrain  data.  Providing  contours  significantly  increases  the  amount  of  information 
which  must  be  monitored  for  changes  and  will  increase  the  frequency  of  chart  revisions. 

The  tradeoff  between  information  content  and  cost  transcends  the  terrain  information  issue. 

In  general,  any  increase  in  the  information  content  of  a  chart  will  increase  the  cost  due  to  the 
larger  number  of  items  which  must  be  monitored  for  changes  and  the  increased  frequency  of 
revisions. 

An  additional  example  of  a  cost-driven  chart  design  is  the  small  size  and  location  of  the 
airport  nmway  diagram  on  the  NOAA  lAP  (Figure  2).  Because  the  complete  set  of  NOAA 
charts  is  reprinted  on  a  58-day  cycle,  it  is  considered  too  expensive  to  include  a  separate 
airport  runway  diagram. 

A  final  example  of  cost  considerations  is  that  the  charts  are  designed  for  the  entire  spectrum 
of  aviation  users.  Because  it  is  too  expensive  to  produce  separate  charts  for  different  user 
groups,  all  the  information  required  for  any  specific  operator  is  included  on  the  chart.  This 
can  be  seen  in  the  minimums  section  of  the  NOAA  and  Jeppesen  charts  in  Figures  2  and  3. 
Minima  for  all  category  operations  (A  to  D)  are  included  increasing  the  clutter  in  this  area. 


22 


3.3  CURRENCY  OF  APPROACH  INFORMATION 


One  concern  which  emerged  from  the  data  analysis  and  interview  effort  regarded  currency  of 
information.  The  primary  means  for  dissemination  of  the  approach  information  to  the  pilot  is 
the  lAP.  Changes  which  occur  at  periods  shorter  than  the  update  cycle  of  the  lAP's  are 
disseminated  by  different  levels  of  Notices  to  Airmen  (NOTAMS).  Problems  were  identified 
both  with  the  currency  of  the  lAP's  and  the  dissemination  of  NOTAMS. 

One  problem  is  the  intentional  or  inadvertent  use  of  outdated  lAP's  by  pilots  or  controllers. 
This  was  identified  in  3  out  of  42  ASRS  reports,  in  the  Training  Center  interviews,  and  in  the 
NOAA  “Callback”  comments.  For  example,  of  the  259  “callback”  comments,  5%  were  due 
to  the  use  of  outdated  charts.  Interestingly,  one  ASRS  report  was  due  to  the  premature  use  of 
an  lAP  before  the  effective  date. 

The  revision  cycle  of  the  NOAA  and  Jeppesen  lAP's  are  quite  different  and  result  in  different 
updating  problems.  The  NOAA  charts  are  completely  reissued  on  a  58-day  cycle  with  a 
Change  Notice  (CN)  issued  midway  through  the  cycle.  Because  the  CN  is  only  effective  for 
half  the  cycle  it  was  reported  to  be  common  practice  for  it  to  be  ignored. 

The  Jeppesen  lAP's  are  revised  on  a  14-day  cycle  which  allows  changes  to  be  much  more 
rapidly  implemented.  However,  the  plates  are  individually  reissued.  Therefore,  a  significant 
amount  of  manual  labor  is  required  to  update  or  file  the  lAP  set  and  there  is  a  large 
opportunity  for  collation  error.  It  was  reported  and  observed  to  be  a  relatively  common 
practice  for  crews  to  fly  with  “unfiled”  revisions  in  their  flight  bags  and  to  update  while  en 
route.  Since  most  lAP  changes  are  relatively  minor,  the  use  of  outdated  lAP's  does  not 
normally  result  in  a  hazardous  condition.  However,  clearly  the  potential  exists  whenever  a 
significant  change  in  a  procedure  is  made,  or  a  pilot  uses  an  out-of-date  lAP. 

The  currency  of  information  on  the  lAP's  is  limited  by  the  preparation  and  update  cycle  of  the 
charting  agency  and  the  time  required  for  notification  to  reach  the  agency.  Typically,  changes 
will  come  through  the  National  Flight  Data  Center  or  the  FAA,  which  may  change  the 
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database  or  issue  NOTAMS.  Permanent,  or  P  NOTAMS,  are  typically  long  duration  changes 
which  are  incorporated  into  the  lAP's  at  the  first  opportunity.  Temporary,  or  T  NOTAMS, 
are  shorter  duration  changes.  Jeppesen  often  publishes  the  T  NOTAM  changes  but,  until 
recently,  NOAA  was  prevented  from  publishing  T  NOTAMS  by  the  Interagency  Cartographic 
Committee,  unless  a  hazard  existed.  The  Chief  of  the  NOAA  Instrument  Approach  Chart 
Division  estimated  that  this  caused  800  known  lAP  errors  at  any  one  time.  This  can  be  seen 
in  the  NOAA  “Callback”  comments  where  14.7%  of  the  responses  related  to  outdated 
information. 

Finally,  it  is  not  clear  that  NOTAMS  are  fully  disseminated  to  the  pilot  population.  The  MIT 
survey  indicated  that  79%  of  the  respondents  felt  that  their  preflight  briefing  procedures 
provided  them  with  the  full  set  of  relevant  NOTAMS.  However,  detailed  questioning  during 
interviews  indicated  that  the  pilots  rely  primarily  on  computer-generated  NOTAMS  provided 
in  their  dispatch  material.  The  completeness  of  these  lists  is  questionable,  particularly  for 
Class  II  NOTAMS  which  are  published  on  a  14-day  cycle.  The  concern  is  even  greater  for 
pilots  receiving  voice  or  computer  weather  briefings,  who  reported  that  they  often  receive  no 
NOTAMS  at  all.  The  possibility  of  reconsidering  the  NOTAM  system  in  the  light  of 
improved  communications  dissemination  systems  is  recommended. 

3.4  TRAINING  AND  OPERATIONAL  USE  PATTERNS 

Most  training  in  lAP  use  occurs  during  initial  instrument  training.  Based  on  the  interview 
responses,  there  does  not  appear  to  be  a  standard  procedure  for  lAP  use  which  is  universally 
applied.  This  is  particularly  true  for  pilots  who  receive  their  initial  instrument  training  in 
civil  general  aviation.  The  most  formal  and  standardized  training  in  lAP  usage  is  found  in 
the  military  and  at  the  corporate  Flight  Training  Centers.  It  is  interesting  to  note  that  there  is 
very  little  training  on  lAP  use  at  the  major  air  carriers  interviewed.  Since  pilots  are  hired 
with  extensive  experience,  it  is  assumed  that  they  “know  how  to  read  an  lAP.”  While  a  self- 
study  guide  was  available  on  one  carrier,  most  of  the  lAP-related  training  focuses  on  specific 
company  procedures  or  airports  with  special  restrictions  such  as  Reno  or  Hong  Kong. 
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The  manner  in  which  the  lAP’s  are  used  was  found  in  the  interview  effort  to  vary  across  the 
spectrum  of  user  groups.  Air  carrier  operations  generally  involve  two  pilot  operations  flying 
into  well-equipped  and  often  familiar  airports.  The  lAP's  are  generally  reviewed  during  the 
descent  and  the  approach  is  often,  but  not  always,  briefed  between  the  two  pilots  who  each 
have  their  own  set  of  charts.  The  pilot  not  flying  is  also  available  to  find  information  during 
the  approach.  The  items  typically  found  in  pre-approach  briefs,  observed  by  the  authors,  as 
described  in  the  interviews,  are  listed  in  Table  1.  In  interviews,  operators  reported 
significantly  different  lAP  usage  for  familiar  airports  than  for  non-familiar  airports.  In  the 
former,  the  lAP  review  was  generally  more  cursory.  In  visual  meteorological  conditions, 
when  a  visual  approach  is  expected,  it  is  standard  procedure  to  review  the  most  relevant  lAP, 
tune  and  use  navaid  for  final  approach  guidance.  In  fact,  it  is  extremely  unusual  for  an  air 
carrier  to  be  equipped  with  charts  suitable  for  visual  only  operations. 


TABLE  1.  TYPICAL  AIR  CARRIER  PRE-APPROACH 
BRIEFING  ITEMS 


Approach  and  Runway 
Chart  Issue  Date 
Primary  Navaid  Frequency 
Inbound  Course 

Intercept  Altitude  at  Final  Approach  Fix 
Airport  Elevation 

Decision  Height/MDA  (MSL  and  AGL) 
Missed  Approach  Procedure 


At  the  high  end  of  corporate  aviation,  the  lAP  use  patterns  are  quite  similar  to  those  of  the  air 
carriers.  However,  because  of  the  unscheduled  nature  of  their  operations,  corporate  pilots  are 
more  often  exposed  to  unfamiliar  airports  and  non-precision  approaches  than  their  air  carrier 
counterparts.  They  also  report  a  difference  in  lAP  use  at  familiar  versus  unfamiliar  airports. 
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At  the  general  aviation  and  low  end  corporate  aviation  level,  the  use  of  lAP's  is  quite 
different.  IFR  operations  are  predominantly  flown  single-pilot.  As  a  result,  there  is  no 
formal  pre-approach  brief  and  the  review  and  use  of  the  lAP  is  much  less  structured. 

Because  of  the  high  workload  in  single-pilot  IFR  operations,  it  is  often  necessary  to  review 
the  lAP  prior  to  departure.  Since  a  second  pilot  is  not  available  to  aid  in  information 
retrieval,  it  is  common  practice  to  attempt  to  memorize  the  critical  information  elements  such 
as  the  Decision  Height  and  initial  missed  approach  instructions.  In  addition,  the  level  of  IFR 
currency  of  many  pilots  is  reported  to  be  so  low  that  there  is  insufficient  opportunity  for 
proficiency  in  lAP  use. 

Based  on  the  ASC  survey  and  the  interview  efforts,  approximately  90%  of  the  civil  LAP  users 
employ  Jeppesen  charts.  Since  ATC  facilities  are  equipped  with  NOAA  charts,  there  is  some 
concern  that  misinterpretation  may  occur  because  of  the  difference  in  charts  seen  by  the  pilot 
and  the  controller. 

Finally,  there  is  some  evidence  that  switching  chart  formats  can  have  a  negative  impact  on 
safety.  In  the  ASC  survey,  pilots  who  used  both  Jeppesen  and  NOAA  charts  reported  more 
difficulty  and  time  in  locating  required  information  and  less  intuitive  information  transfer  than 
those  who  used  only  Jeppesen  or  NOAA.  Because  of  the  negative  impact  of  format  changes 
on  information  transfer,  and  the  extensive  experience  base  with  the  current  lAP  format, 
significant  performance  or  safety  improvements  must  be  expected  before  major  format 
changes  in  the  lAP's  can  be  justified. 

3.5  OPERATIONAL  ERROR 

As  a  result  of  the  data  analysis,  interviews,  and  survey  efforts,  several  areas  were  identified 
where  lAP  design  could  be  improved  to  reduce  the  risk  of  operational  errors.  In  the  MIT 
survey,  93%  of  the  respondents  felt  that  it  was  possible  to  make  errors  in  the  cockpit  which 
are  directly  attributable  to  charting  considerations.  Several  of  these  operational  errors  are 
discussed  next. 
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3.5.1  Confusion  Between  Primary  and  Secondary  Navaid  Frequencies 


The  most  frequently  cited  critical  operational  error  related  to  lAP  design  was  the  confusion 
between  the  primary  and  secondary  navaid  frequencies.  As  an  example,  if  on  the  ILS  runway 
6  approach  to  Teterbury,  NJ  as  shown  in  Figure  3,  the  collocated  VOR  frequency  (108.4, 
ID=TEB)  was  selected  instead  of  the  ELS  frequency  (108.9,  ID=ITEB),  significant  errors  in 
lateral  guidance  could  occur.  The  similarity  of  the  ID's  would  make  this  error  difficult  to 
pick  up  by  the  ID  alone.  This  type  of  error  contributed  to  the  first  accident  cited  in  the 
NTSB  letter  (Appendix  A)  and  is  relatively  common  (47%  of  the  MIT  respondents  reported 
making  this  error). 

Efforts  have  been  made  to  minimize  this  error  by  distinguishing  the  primary  navaid  box  as 
shown  in  Figure  8.  The  Jeppesen  charts  use  a  perspective  line  box,  while  the  NOAA  charts 
use  a  bold  line  box.  In  addition,  Jeppesen  repeats  the  primary  navaid  frequency  m  the 
procedure  ID  area  of  the  chart.  While  the  efforts  are  eommendable,  no  objective  evaluation 
of  these  improvements  has  been  made  and  the  effectiveness  of  the  presentation  is  not  known. 

3.5.2  Confusion  on  Approach  Minimums 

The  identification  of  the  correct  Decision  Height  (DH)  or  Minimum  Decision  Altitude  (MDA) 
is  a  critical  part  of  any  approach.  In  the  ASC  survey,  15%  of  the  Jeppesen  and  25%  of  the 
NOAA  users  reported  confusion  in  interpreting  MDA's  or  DH's  on  the  charts.  Because  of  the 
importance  of  the  minimums,  even  these  relatively  low  numbers  are  unacceptable. 

The  differences  between  Jeppesen  and  NOAA  users  may  be  due  to  a  difference  in 
presentation  of  the  minimums.  In  the  Jeppesen  charts,  the  different  minimums  are  presented 
for  all  potential  scenarios.  While  this  increases  the  elutter  in  the  minimums  section,  it 
reduces  the  cognitive  effort  required  to  find  the  appropriate  DH  or  MDA. 

On  the  NOAA  charts,  a  basic  set  of  minimums  are  presented  and  adjustments  are  made  for 
nonstandard  conditions  through  notes.  For  example,  in  Figure  9,  the  minimums  notes  section 
reads;  ‘‘When  Control  Zone  Not  in  Effect:  1.  Use  Islip  altimeter  setting.  2.  Increase  all 
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JEPPESEN  EXAMPLE 


P 


FIGURE  8.  EXAMPLE  OF  PRIMARY  NAVAID  FREQUENCY  IDENTIEICATION 
BOXES  FROM  NOAA  AND  JEPPERSEN  lAP'S 
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NOT  TO  BE  USED  FOR  NAVIGATION 


Arndt  5  88042 

ILS  RWY  6 

NEW  YORK  APR  CON 
126.95  367.2 
BRIDGEPORT  TOWER* 
12D.9(J(CTAF}  257.8 
GND  CON 
121.9  257.8 
CLNC  DEL 
,  121.75 
I  ATIS  *  119/15 
BRIDGEPORT  RA;?10 
122.2  - 


AL-621  (FA. 


«»=E.O«T,IGO«  . 


ILS  RWY  6 


^  BRIDGEPORT,  CONNECTICUT 

^  I  CII/nR^KY  memorial  (BDR) 


figure  9.  EXAMPLE  OF  NOAA  CHART  WITH  MINIMUM  MODIFICATION 
NOTE  SHOWN 
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DHlMDA's  80  feet.”  While  the  instructions  are  clear,  there  is  evidence  from  the  interviews 
and  the  NTSB  reports  that  supplementary  notes  are  often  missed.  This  combined  with  the 
additional  cognitive  addition  step  makes  it  likely  that  pilots  will  use  the  printed  DH  even 
though  this  means  that  they  would  descend  80  feet  below  minimums.  This  factor  is 
considered  to  be  the  reason  that  10%  more  of  the  NOAA  respondents  in  the  ASC  survey 
reported  confusion  on  interpreting  DH  and  MDA's. 

3.5.3  Missing  Notes 


Based  on  the  MIT  survey  and  interview  effort,  supplementary  notes  are  often  a  low  priority 
item  during  an  lAP  review.  Part  of  the  reason  for  this  is  the  impression  that  important 
information  will  be  depicted  in  the  procedure,  and  that  notes  are  of  secondary  importance.  As 
can  be  seen  in  the  discussion  of  DH/MDA  notes  above,  and  the  fact  that  misinterpretation  of 
supplementary  information  was  cited  in  two  of  the  nine  NTSB  accidents  (Appendix  A),  this 
impression  is  often  not  true.  There  is,  however,  no  clear  mechanism  to  distinguish  the 
priority  of  notes  on  the  lAP's.  The  ALPA  Charting  Committee  recommended  publishing 
important  notes  in  reverse  print.''’ 

3.5.4  Confusion  on  Minimum  Safe  Altitudes 

As  discussed  above,  reduction  of  “controlled  flight  into  terrain”  accidents  is  currently  an  area 
of  focus  within  the  aviation  safety  community.  There  is  a  general  preference  for  smoothed 
contours  as  opposed  to  the  use  of  spot  elevations  for  terrain  presentation.  Tradeoffs,  however, 
exist  in  this  area  and  are  discussed  in  Section  3. 

Several  of  the  interviewees  reported  that  the  Minimum  Safe  Altitude  (MSA)  circle  (an 
example  is  shown  in  Figure  10)  is  the  most  reliable  and  effective  means  for  assuring  terrain 
separation.  One  difficulty  is  that  there  is  a  natural  tendency  to  assume  that  the  MSA  is 
centered  on  the  airport,  where  it  is  actually  centered  on  a  navaid  often  not  collocated  with  the 
airport.  In  addition,  the  MSA  does  not  correspond  with  the  ATC  Minimum  Vectoring 
Altitude  (MVA).  It  is  common  practice  to  be  vectored  at  altitudes  below  the  MSA. 
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MINIMUM  SAFE  ALTITUDE  (MSA) 


(Arrows  on  distance  circle  identify  sectors) 


FIGURE  10.  EXAMPLE  OF  SAFE  ALTITUDE  [8] 
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3.5.5  Complexity  of  the  Procedures 


It  should  be  noted  that  several  sources  reported  problems  with  lAP  use  which  were  actually 
the  result  of  complexity  of  the  underlying  procedure.  For  example,  there  were  five  separate 
ASRS  reports  on  the  Los  Angeles  LAX  profile  descent,  and  various  other  examples.  While 
these  are  not  explicitly  cartographic  problems,  it  is  important  to  retain  as  much  simplicity  as 
possible  in  the  underlying  procedures. 

This  problem  can  also  be  seen  in  the  missed  approach  phase.  In  the  ASC  survey,  47%  of  the 
respondents  reported  that  the  procedures  for  missed  approach  and  holding  generated  excessive 
workload  during  the  go-around.  This  question  was  also  rated  as  the  highest  priority  area  by 
the  respondents.  In  the  MIT  interviews  and  survey,  it  was  reported  that  it  is  unusual  to  fly 
the  published  missed  approach  procedure  and  often  special  instructions  are  issued  by  the 
ATC.  While  it  is  recognized  that  the  missed  approach  procedures  will  vary  with  the 
controllers  tactical  situation,  the  published  approach  should  as  accurately  as  possible  reflect 
the  common  missed  approach  procedure  in  current  use. 

3.5.6  Runway  Length  and  Li2htin£  Information 

There  were  several  reports  of  problems  which  arose  over  the  lack  of  runway  length  or 
lighting  information  on  the  Jeppesen  approach  charts.  While  the  information  is  on  the  airport 
runway  diagram  chart  (10-1),  it  is  not  available  on  the  approach  side  of  the  chart  for  quick 
reference  during  the  approach. 

3.5.7  Awareness  of  Common  ILS  Frequencies 

With  the  more  frequent  use  of  a  single  ILS  frequency  for  several  runways  at  the  same  airport, 
several  respondents  requested  the  inclusion  of  some  indication  of  this  on  the  chart.  There  is 
concern  that  the  ILS  system  could  be  activated  on  the  wrong  runway,  giving  erroneous 
guidance  indications  to  the  crew. 
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3.6  Electronic  Approach  Plates 


The  MIT  survey  and  interview  efforts  included  questions  related  to  the  potential  for  the 
presentation  of  lAP  information  in  electronic  format.  There  was  generally  overwhelming 
support  for  electronic  lAP's.  It  was  felt  that  issues  such  as  currency  of  information  will  be 
much  less  of  a  problem  in  the  electronic  format. 

Because  of  its  potential  flexibility,  the  electronic  approach  chart  also  allows  for  an  increase  of 
information  such  as  terrain  contours  and  the  direct  interface  between  the  charts  and  the  Flight 
Management  Systems  which  would  reduce  operator  input  errors. 

On  the  negative  side,  in  addition  to  the  obvious  cost  issues,  there  is  a  concern  over  increased 
workload,  system  reliability,  the  database  integrity  and  the  need  to  reformat  the  lAP  databases 
to  an  object-oriented  structure.  Electronic  display  limitations  will,  in  the  short  term,  limit  the 
amount  of  information  which  can  be  displayed  on  the  screens.  This  has  driven  some 
organizations  to  use  cockpit  printers  for  electronic  lAP's. 

In  the  long  term,  it  is  generally  agreed  that  electronically  based  lAP's  which  interact  with  the 
aircraft's  Flight  Management  System  and  Communications  System  will  emerge.  This  is  seen 
as  an  opportunity  to  reconsider  lAP  formats  in  light  of  the  flexibility  and  capability  of  the 
electronic  systems.  A  significant  amount  of  work  is  required  to  optimize  these  systems  in 
terms  of  both  human  interface  and  functionality. 
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4.  CONCLUSION 


The  literature  review,  pilot  opinion  surveys,  data  analysis  and  interview  efforts,  conducted  to 

identify  operational  errors  and  crew  preferences  related  to  Instrument  Approach  Charts 

resulted  in  the  following  findings. 

1 .  Current  lAP's  are  the  result  of  a  mature  evolutionary  process  driven  by  user  feedback, 
concern  over  flight  safety,  and  the  liability  of  the  charting  agencies.  Even  though  the 
charts  have  evolved  in  the  absence  of  formal  human  factors  analysis,  major  changes  in 
format  for  paper  approach  charts  does  not  appear  to  be  indicated. 

2.  Current  lAP's  represent  a  balance  between  different  chart  design  tradeoffs. 
Fundamental  tradeoffs  were  identified  in  the  areas  of:  chart  size  versus  legibility, 
information  content  versus  clutter,  and  cost  tradeoffs. 

3.  Concern  over  “controlled  flight  into  terrain”  accidents  has  motivated  an  increased 
interest  in  terrain  information  on  the  lAP's.  The  current  technique  of  presenting 
terrain  information  through  spot  elevations  is  considered  ineffective  and  contributes  to 
chart  clutter.  Smoothed  contours  have  been  used  effectively  to  portray  terrain 
information.  However,  the  resulting  increase  in  data  monitoring,  chart  revision,  and 
production  costs  has  contributed  to  preventing  full  implementation  by  US  chart 
producers. 

4.  Several  problems  were  identified  relating  to  the  currency  of  information  available  to 
the  flight  crews  both  on  the  lAP's  and  through  Notices  to  Airmen  (NOTAMS). 

5.  Significant  differences  in  lAP  operational  use  patterns  were  observed  between  user 
groups  particularly  between  multi-crew  air  carrier  operations  and  single  pilot  general 
aviation  operations.  Cost  factors  preclude  lAP  designs  focused  for  specific  user 
groups. 
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6.  Some  evidence  was  found  that  switching  between  lAP  formats  reduced  the 
effectiveness  of  information  transfer  from  the  charts.  This  argues  that  a  significant 
performance  or  safety  improvement  should  be  expected  before  major  format  changes 
are  implemented.  In  addition,  formal  human  factors  review  of  proposed  changes 
would  help  quantify  the  potential  improvements. 

7.  In  the  MIT  survey,  93  percent  of  the  pilots  felt  that  it  was  possible  to  make 
operational  errors  due  to  chart  design.  Several  potential  operational  errors  were 
identified  including;  confusion  between  primary  and  secondary  navaid  frequencies, 
confusion  on  approach  minimums,  missing  chart  notes,  confusion  on  minimum  safe 
altitudes,  complexity  of  the  procedures,  location  of  runway  lighting  information,  and 
awareness  of  dual  use  common  ILS  frequencies. 

8.  The  potential  of  electronic  lAP's  offers  the  opportunity  for  more  flexibility  in  the 
presentation  of  approach  information.  However,  concerns  about  system  reliability, 
data  integrity  and  structure,  and  crew  workload  have  emerged.  It  is  generally  agreed 
that  electronically  based  lAP's  will  emerge  within  the  next  five  years,  and  it  is 
important  to  reconsider  the  lAP  human  factors  issues  in  light  of  the  flexibility, 
capability  and  limitations  of  the  electronic  systems. 
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Appendix  A 


NATIONAL  TRANSPORTATION  SAFETY  BOARD 

WASHINGTON,  D.C. 


ISSUED:  August  18,  1982 


Forward  to:  1 

Honorable  J.  Lynn  Helms  (  SAFETY  RECOMMENDATION  (S) 

Administrator  ( 

Federal  Aviation  Administration  \  A-82-91  through  -93 _ 

Washington,  D.C.  20591  I 


About  11:27  PST,  on  January  20,  1981,  a  Cascade  Airways,  Inc.,  Beech  99A  aircraft  en 
route  from  Moses  Lake,  Washington,  to  Spokane,  Washington,  crashed  about  4.5  miles  southwest 
of  Spokane  International  Airport.  The  accident  occurred  while  the  pilot  was  making  a  localizer 
instrument  approach  to  Runway  3.  Seven  persons  including  the  flightcrew  were  killed  and  two 
passengers  were  injured  seriously. 

The  localizer  course  Runway  3  approach  at  Spokane  International  Airport  is  served  by 
two  navigational  aids  which  provide  distance  information:  the  Spokane  VORTAC  V  and  the 
localizer  distance  measuring  equipment  (lOLJ  DME).  During  its  investigation,  the  Safety  Board 
interviewed  several  pilots  who  stated  that  they  had  experienced  confusion  which  resulted  in 
procedural  errors  during  the  approach  procedure  into  Spokane.  The  pilots  indicated  that  they  had 
reviewed  the  approach  procedure  and  had  used  the  Spokane  VORTAC,  mistakenly  believing  that 
it  was  the  correct  distance  information  facility  to  use  for  the  localizer  approach;  whereas,  lOLJ 
DME  was  the  correct  facility.  However,  by  using  the  Spokane  VORTAC,  they  had  flown  at  too 
low  an  altitude  which  was  not  corrected  until  they  were  advised  by  an  air  traffic  controller  or  an 
instructor  pilot  who  had  visual  contact  with  the  terrain.  Two  of  the  pilots  further  stated  that  they 
had  reviewed  the  approach  with  other  pilots,  most  of  whom  indicated  that  they  would  have  been 
prone  to  make  the  same  mistake. 

As  a  result  of  the  investigation  of  the  January  20,  1981  accident,  the  Safety  Board 
recommended  that  the  FAA  add  a  precautionary  note  on  approach  charts  for  procedures  involving 
two  DME  facilities  on  the  final  approach  course.  (Safety  Recommendations  A-81-40  and  -41.) 

The  Safety  Board  has  investigated  other  accidents  involving  approach  procedures  and  the 
approach  charts  design.  The  following  is  a  brief  summary  of  some  of  those  investigations: 


V  A  collocated  very  high  frequency  omni-directional  range  station  (VOR)  and  ultra-high  frequency  tactical  air  navigation  aid 
(TACAN). 
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On  October  24,  1971,  a  Monmouth  Airlines,  Inc.  scheduled  Air  Taxi,  Beech  99, 
descended  prematurely  and  struck  a  mountain  while  executing  a  VOR  instrument 
approach  to  the  Allentown-Bethlehem-Easton  Airport,  Allentown,  Pennsylvania. 
Four  persons  were  killed  and  four  persons  were  injured  seriously.  The  Allentown 
area  is  served  by  two  airports:  The  Bethlehem-Easton  Airport  and  the  Queen  City 
Municipal  Airport.  Both  airports  have  a  VOR-1  published  approach  but  use 
different  VOR’s.  The  Safety  Board  believes  that  the  crew  of  the  accident  aircraft 
may  have  read  the  minimum  altitude  at  the  final  approach  fix  from  the  wrong 
approach  chart.  Because  of  the  similarity  of  the  two  approach  plates  for  the 
contiguous  airports,  the  Safety  Board  recommended  that  the  Federal  Aviation 
Administration  (FAA):  (1)  required  that  conspicuous  and  distinctive  markings  be 
affixed  to  the  two  approach  plates  so  that  pilots  could  identify  the  plates  more 
readily  and  quickly;  and  (2)  review  all  approach  charts  for  potential 
misidentification.  (Safety  Recommendations  A-71-61  and  62.) 

On  September  4,  1971,  an  Alaska  Airlines,  Inc.,  Boeing  727,  crashed  while 
attempting  a  nonprecision  instmment  approach  to  the  Juneau  Municipal  Airport, 
Juneau,  Alaska.  All  104  passengers  and  7  crewmembers  were  fatally  injured.  The 
investigation  revealed  that  the  published  localizer  directed  approach  (EDA) 
procedure  had  not  been  amended  to  reflect  the  commissioning  of  the  DME 
associated  with  the  localizer.  The  Safety  Board  recommended  that  the  FAA 
amend  this  approach  chart  to  include  the  localizer  DME.  (Safety 
Recommendation  A-72-14.) 

On  September  8,  1973,  a  World  Airways,  Inc.,  DC-8-63F,  Military  Airlift 
Command  contract  cargo  flight  crashed  into  a  mountain  (3,500  feet)  near  King 
Cove,  Alaska,  about  15.5  miles  east  of  the  airport.  The  flight  had  been  cleared 
for  an  approach  125  miles  east  of  the  airport.  The  three  crewmembers  and  three 
passengers  were  killed,  and  the  aircraft  was  destroyed.  As  a  result  of  its 
investigation,  the  Safety  Board  recommended  that  the  FAA  modify  the  approach 
chart  to  reflect  altitude  restrictions  and  potential  hazards  associated  with  this 
approach  procedure.  (Safety  Recommendation  A-74-53.) 

On  December  1,  1974,  a  Trans  World  Airlines,  Inc.,  B-727,  crashed  into  a 
mountain  ridge  while  descending  for  a  VOR/DME  approach  to  Runway  12  at 
Dulles  International  Airport,  Washington,  D.C.  The  85  passengers  and  7 
crewmembers  were  killed,  and  the  aircraft  was  destroyed.  The  Safety  Board 
determined  that  a  contributing  factor  in  the  accident  was  the  inadequate  depiction 
of  altitude  restrictions  on  the  profile  view  of  the  approach  chart  for  the  VOR/DME 
approach  to  runway  12  at  the  airport.  The  Safety  Board  issued  four 
recommendations  to  the  FAA  which  addressed  the  need  for  uniformity  and 
standardization  of  cartographic  techniques  and  specifications  in  the  design  of 
approach  charts.  (Safety,  Recommendations  A-75-74  through  -77.) 
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•  On  February  21,  1975,  a  Beechcraft  BE-55  aircraft  crashed  during  the  hours  of 
darkness  while  on  a  unauthorized  instrument  approach  to  the  Lawrenceburg 
Municipal  Airport,  Lawrenceburg,  Tennessee,  which  was  not  approved  for  night 
operations.  As  a  result  of  its  investigation,  the  Safety  Board  recommended  that 
the  FAA  clarify  the  wording  of  the  restrietion  on  approach  charts  for  locations 
where  night  approaches  are  not  authorized  so  that  the  restrictions  are  elearly 
understood.  (Safety  Recommendation  A-75-70.) 

•  On  May  8,  1978,  a  National  Airlines,  B-727,  crashed  while  exeeuting  an  airport 
surveillance  radar  (ASR)  approach  to  runway  25  at  Pensacola  Regional  Airport, 
Pensacola,  Florida.  Three  passengers  were  killed.  As  a  result  of  its  investigation, 
the  Safety  Board  recommended  that  the  FAA  develop  requirements  for  depicting 
final  approach  fixes  or  minimum  altitudes  for  each  mile  on  the  final  approaches 
for  ASR  instrument  procedures.  (Safety  Recommendation  A-79-10.) 

•  On  October  31,  1979,  a  Western  Airlines,  Inc.,  DC-10-10,  crashed  while  making 
an  instrument  landing  system  (ILS)  approach  to  the  Mexico  City  International 
Airport.  Sixty-one  passengers  and  11  crewmembers  were  fatally  injured;  13 
passengers  and  2  crewmembers  were  seriously  injured;  and  one  person  on  the 
ground  was  fatally  injured.  The  aircraft  was  destroyed.  The  aircraft  was  cleared 
to  land  by  means  of  a  sidestep  maneuver  which  was  not  performed  by  the  pilot. 

As  a  result  of  the  investigation,  the  Safety  Board  recommended  that  the  FAA 
require  separate  standardized  instrument  approach  charts  for  sidestep  maneuver 
approaehes.  (Safety  Recommendation  A-80-59.) 

•  On  October  24,  1980,  a  Beeehcraft  BE-18S,  crashed  while  executing  a  missed 
approach  from  the  Gainesville,  Florida  Regional  Airport.  The  pilot  had  been 
advised  by  the  air  traffie  controller  to  execute  the  published  missed  approaeh 
procedure  after  he  had  reported  that  he  had  missed  the  approach.  However,  the 
aircraft  continued  straight  ahead  and  collided  with  a  TV  antenna  tower.  All  three 
occupants  of  the  aircraft  were  killed.  As  a  result  of  the  investigation,  the  Safety 
Board  recommended  that  the  Inter-Agency  Air  Cartographic  committee  amend  the 
depiction  of  the  missed  approach  track  on  approach  charts.  (Safety 
Recommendation  A-81-34.) 

All  of  the  foregoing  recommendations  addressed  two  basie  issues— our  belief  that 
insufficient  attention  is  given  to  human  performance  criteria  in  the  development  of  approaeh 
procedures  and  in  the  process  for  reviewing  the  approach  procedure  depiction  on  the  approaeh 
charts-both  of  whieh  are  deficiencies  that  can  lead  to  confusion  and  mistakes  by  the  pilot  users. 
Pilots  have  been  criticized  for  misinterpreting  approach  charts  and  approach  procedures,  with 
little  eonsideration  given  to  the  operating  environment  in  whieh  the  procedures  and  charts  are 
used  and  the  degree  to  which  these  procedures  and  charts  themselves  may  be  conducive  to  error. 
The  Safety  Board  believes  that  it  is  the  obligation  of  the  developers  of  approach  procedures  and 
eharts  to  incorporate  human  factors  considerations  into  their  design  so  that  the  possibility  for  pilot 
confusion,  misinterpretation,  or  error  is  eliminated. 
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In  the  public  hearing  convened  by  the  Safety  Board  regarding  the  January  21,  1981 
accident,  testimony  by  spokesmen  for  the  FAA  revealed  that  there  are  no  specific  human 
performance  criteria  for  developing  approach  procedures,  or  formal  human  performance  checklists 
or  guidelines  for  the  procedures  specialist  or  flight  inspection  pilot  who  flies  and  evaluates  the 
approach  procedure.  The  Safety  Board  believes  that  factors,  such  as  user/pilot  intelligibility, 
workload,  attention  demands,  human  memory  limitations,  and  other  sensory,  perceptual,  and 
cognitive  restrictions,  must  be  considered  when  designing  approach  procedures. 

Also,  the  hearing  testimony  revealed  that  the  FAA  does  not  formally  review  the  approach 
charts  designed  by  the  National  Ocean  Survey  and  Jeppesen  Company  with  the  above  issues  in 
mind.  The  Safety  Board  believes  that  human  performance  standards  should  include  design 
criteria  for  presentation  of  information  and  chart  configuration  to  promote  user/pilot 
interpretability  and  usability,  as  well  as  such  issues  as  visual  detection,  identification,  coding, 
attention-getting  characteristics,  and  human  memory  considerations. 

On  July  2, 1981,  the  Presidents’s  Task  Force  on  Aircraft  Crew  Complement  said  "Enroute, 
terminal  area,  and  approach  charts  are  frequently  designed  in  a  way  that  makes  them  difficult  to 
use."  Further,  the  Task  Force  said,  "The  design  and  content  of  these  charts  should  be  improved." 

Currently,  two  committees  address  the  charting  and  flight  information  issues:  the  Inter- 
Agency  Air  Cartographic  (lACC)  Committee  and  the  Intra-Agency  Committee  for  Flight 
Information  (lACFI).  The  lACC  Committee  consists  of  members  from  the  Department  of 
Defense,  the  Department  of  Commerce,  and  the  FAA;  its  function  is  to  develop  specifications 
for  acceptable  cartographic  means  of  depicting  aeronautical  information.  The  FAA’s  role  on  this 
committee  is  directed  to  the  civil  aviation  user  requirements.  The  lACFI  is  an  in-house  FAA 
multidimensional  technical  group  that  addresses  particular  issues  relating  to  aviation  information 
and  standards.  No  member  of  the  lACFI  is  specifically  trained  in  the  human  performance  area. 

As  a  result  of  past  Safety  Board  recommendations,  the  FAA  has  taken  action  to  modify 
specific  procedures  on  a  case-by-ease  basis;  however,  an  attack  on  the  aggregate  problem  by 
alleviating  individual  approaeh  procedure  problems  on  a  post-accident  basis  is  not  satisfactory. 
A  better,  more  efficient  method  would  be  to  incorporate  human  factors  design  considerations  into 
the  development,  design,  and  evaluation  of  all  approach  procedures  and  approach  charts  before 
accidents  occur. 

Therefore,  the  National  Transportation  Safety  Board  recommends  that  the  Federal  Aviation 
Administration: 

Establish  formal  human  performance  criteria  for  the  development  and 
evaluation  of  instrument  approach  procedures  and  instrument  approaeh 
charts.  (Class  II,  Priority  Action)  (A-82-91) 

Establish  human  performance  checklists  or  guidelines  for  use  by 
procedures  specialists  and  fight  inspection  pilots  when  evaluating  new 
approach  procedures.  (Class  II,  Priority  Action)(A-82-92) 
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Assign  personnel  trained  in  human  engineering  and  human  performance  to 
the  Interagency  Air  Cartographic  Committee  and  the  Intra-Agency 
Committee  for  Flight  Information.  (Class  II,  Priority  Action)(A-82-93) 


BURNETT,  Chairman,  GOLDMAN,  Vice  Chairman,  and  McADAMS  and  BURSLEY, 
Members,  concurred  in  these  recommendations. 


By:  Jim  Burnett 

Chairman 


r 


Appendix  B 

SURVEY  OF  APPROACH  CHART  INFORMATION  REQUIREMENTS 


Purpose 

The  Department  of  Aeronautics  and  Astronautics  at  the  Massachusetts  Institute  of  Technology  is 
currently  evaluating  the  design  and  format  of  aeronautical  charts.  The  focus  of  this  survey  is  to  evaluate 
the  importance  of  instrument  approach  information  available  to  the  pilot,  and  to  determine  at  what  point 
during  the  approach  procedure  it  is  most  desirable  to  have  this  information. 

By  investigating  crew  preferences  related  to  Instrument  Approach  Plates  (lAP’s),  and  surveying 
the  information  content  of  these  plates,  we  hope  to  gain  an  understanding  of  pilot  preferences  concerning 
the  categorization  and  prioritization  of  approach  chart  information  as  it  pertains  to  phase  of  flight.  This 
information  will  help  us  to  determine  what  information  should  be  contained  on  advanced  electronic 
instrument  approach  plate  designs. 

Structure 

This  survey  consists  of  four  parts  and  will  take  approximately  30  minutes  to  complete.  As  an 
introduction  to  each  individual  section,  a  brief  description  and  background  is  provided.  Section  I  consists 
of  questions  concerning  your  aviation  background.  The  second  section  asks  you  to  describe  your 
preferences  concerning  the  utilization  of  the  information  currently  contained  on  instrument  approach  plates. 
In  the  third  section,  you  will  be  presented  with  sample  precision  and  non-precision  Jeppeson-Sanderson 
lAP’s  and  asked  to  identify,  per  phase  of  flight,  the  approach  information  you  feel  is  critical  to  complete 
that  particular  phase  of  flight.  The  final  section  seeks  to  determine  your  preferences  regarding  electronic 
instrument  approach  plates. 

Please  remember  that  this  is  only  a  survey  of  your  opinions  and  that  there  are  no  “correct" 
answers  to  these  questions.  Your  assistance  in  this  survey  is  crucial  to  helping  us  prioritize  the 
information  of  current  lAP’s. 

**All  information  provided  will  remain  strictly  confidential** 


The  Survey  Team 

The  individuals  conducting  this  survey  are  experienced  aviators  well  versed  in  instrument  approach 
procedures.  We  are  always  available  and  interested  in  your  opinions.  Please  feel  free  to  call  or  contact 
us  at  any  time  if  you  have  any  questions  regarding  the  survey  or  wish  to  discuss  anything  concerned  with 
this  project. 


Faculty  Representative: 

Prof.  R.  John  Hansman,  Jr. 

Aeronautical  Systems  Laboratory 
MIT,  Rm.  33-115 
77  Massachusetts  Ave. 
Cambridge,  MA.  02139 
(617)  253-2271 


Research  Assistant: 

Mark  G.  Mykityshyn 

Aeronautical  Systems  Laboratory 
MIT,  Rm.  37-442 
77  Massachusetts  Ave. 
Cambridge,  MA.  02139 
(617)  253-7748 


B-1 


I.  BACKGROUND  INFORMATION 


A.  Purpose 


Information  concerning  your  aviation  background  will  help  us  to  more  accurately  assess  the 
variables  that  affect  pilot  preferences.  Remember,  all  information  you  provide  will  remain  completely 
anonymous. 


B.  Personal  Data/Miscellaneous  Information 


1.  Age: _  Sex;  Male  (  )  Female  (  ) 

2.  Highest  Education  Level: 

(  )  High  School  (  )  College  (  )  College  Degree  (  )  Graduate  Work/Degree 


3.  Highest  math  level 

Arithmetic 

Beyond  Calculus 

1  2 

3 

4 

5 

4.  Do  you  have  any  experience  on  Right  Management  Computer  (FMC)  equipped  aircraft? 

Yes(  )  No(  ) 

5.  Computer  experience  (other  than  FMC)  as  a  user. 

No  knowledge  of  Knowledge  of 

software  packages  several  software  packages 

1  2  3  4  5 

6.  How  often  do  you  use  computers  (hours  per  week)  as  a(n): 

Recreational  User  (  )  Operational  User  (  ) 

(Workplace  only) 

Do  not  use  computers 

if  I  don’t  have  to  (  ) 
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C.  Aviation  Experience 

1 .  How  were  you  initially  trained  to  fly? 

Civil  (  )  Military  (  ) 

2.  Civil  Experience: 

A.  Total  civil  pilot  flight  time: _ 

B.  Pilot  ratings  held: 

Fixed  Wing:  ATP  (  )  Commercial  Pilot  (  )  F.E.  Written  (  ) 

Rotary  Wing:  ATP  (  )  Commercial  Pilot  (  )  Other _ 

C.  Civil  flight  experience  by  aircraft  type: 

Rotary  Wing  (  )  Fixed  Wing  (  )  (  )  Both 

3.  Military  Flight  Experience: 

A.  Total  military  flight  time: _ 

B.  Military  flight  experience  by  aircraft  type: 

Rotary  Wing  (  )  Fixed  Wing:  Tactical  (  )  Transport  (  )  Both  (  ) 

C.  Do  you  currently  fly  in  the  military  reserves? 

Yes  (  )  No  (  ) 

D.  Transport  Category  Aircraft  Flying  Experience 

1. 

AIRCRAFT  TYPE  FLIGHT  HOURS  (Approximate)  POSITION* 

J _ 

2 _ _ _ 

3  _ _ _ 

4  - 

5  _ _ _ 

^Captain.  First  Officer,  Second  Officer,  Fliglit  Instructor/aieck  Pilot 

2,  Estimated  Flight  Hours  in  1989  _ 
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II.  GENERAL  lAP  USAGE 


A.  Purpose 

The  purpose  of  this  section  of  the  survey  is  to  help  us  evaluate  the  information  content  of  the  two 
most  widely  used  domestic  lAP’s,  Jeppeson-Sanderson  Inc.,  and  the  U.S.  Government  (NOAA  and  the 
Department  of  Defense  in  conjunction  with  the  FAA). 

Please  evaluate  the  information  content  of  these  lAP’s  with  regard  to  factors  that  contribute  to 
approach  plate  clutter;  for  example,  terrain  and  obstruction  information,  and  describe  your  preferences 
concerning  the  use  of  available  instrument  approach  plate  information. 


B.  Information  Content 


1.  With  which  lAP  have  you  had  the  most  experience?  If  other,  please  specify. 
(  )  Jeppeson-Sanderson  (  )  NOAA/DOD  (  )  Other 


2.  Which  lAP  do  you  currently  use  the  most  often: 

(  )  Jeppeson-Sanderson  (  )  NOAA/DOD  (  )  Other 

For  questions  3-7,  please  answer  based  on  the  response  given  for  question  (1) 

above. 

3.  Aviators  have  stated  that  there  can  be  both  too  much  and  too  little  information  contained  at  the  same 
time  on  an  lAP.  How  do  you  feel  about  the  quantity  of  information  presented  on  lAP’s?  Please 
comment. 

Not  enough  Too  much 

information  information 


1 


2 


3 


4 


5 


4.  Is  the  critical  information,  i.e.,  a  localizer  frequency,  difficult  to  locate  or  interpret?  Please  comment. 


Never 

Occasionally 

Always 

1 

2 

3 

4 

5 

*NOTE:  For  questions  5  and  6,  assume  that  the  terminal  area  is  defined  as  the  area  within  a 
30NM  radius  of  the  airfield.  You  are  the  pilot  “hand  flying”  the  approach  in  IFR  conditions  under  radar 
control. 

5.  What  percentage  of  your  time,  on  average,  do  you  spend  in  the  terminal  area  finding  and  selecting 
approach  information  from  the  lAP?  Please  circle  one  of  the  following  and  comment  on  your 
interpretation  of  how  much  time  comprises  the  two  categories  provided. 


An  acceptable 

An  unacceptable 

amount 

amount 

1  2 

3 

4  5 

Category 

Time  spent  (approximate) 

1 .  “An  acceptable  amount” 

5.  “An  unacceptable  amount” 


6.  During  peak  workload  conditions;  i.e.,  when  you  are  performing  a  difficult  instrument  approach 
procedure  to  an  unfamiliar  airfield,  what  is  the  maximum  percentage  of  time  you  spend  in  the  terminal  area 
interpreting  and  selecting  approach  information?  Please  comment  on  your  interpretation  of  how  much 
time  comprises  these  categories. 


An  acceptable 

An  unacceptable 

amount 

amount 

1  2 

3 

4  5 

Category 

Time  spent  (approximate) 

1.  “An  acceptable  amount” 

5.  “An  unacceptable  amount” 
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7.  Instead  of  “hand  flying”  the  approach,  assume  that  you  are  performing  an  autoflight  approach.  Please 
describe  any  differences  in  the  time  spent  interpreting  approach  information. 


8.  Do  you  feel  that  it  is  possible  to  make  errors  in  the  cockpit  that  can  be  directly  attributed  to  charting 
considerations?  If  yes,  please  comment  on  the  nature  of  these  errors. 


(  )  Yes  (  )  No 


9.  What  are  the  most  common  errors  you  make  or  are  aware  that  others  have  made  reading  the  instrument 
approach  plate? 


10.  What  mistakes,  if  any,  have  you  made  looking  for  communication  frequencies? 


11.  Do  you  require  the  same  approach  information  for  a  precision  and  nonprecision  approach?  If  no, 
what  information  is  different? 


(  )  Yes  (  )  No 


12.  Do  you  follow  a  certain  procedure  that  allows  you  to  have  access  to  a  full  set  of  NOT AMS? 


(  )  Yes  (  )  No 

13.  Have  you  ever  observed  anyone  using  noncurrent  charts? 

Never  Frequently 

1  2  3  4  5 
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14.  Under  which  conditions  do  you  experience  more  problems  reading  the  chart?  Please  comment  on 
what  information  is  hard  to  read. 

(  )  Bright  Light  (  )  Low  Light 


Please  answer  the  following  three  questions  only  if  you  use  both  Jeppeson-Sanderson  and  NOAA  charts: 

1.  What  problems  do  you  encounter  when  switching  back  and  forth  from  NOAA  charts  to  Jeppeson- 
Sanderson  charts? 


2.  Do  you  confuse  the  primary  navaid  frequency  for  the  approach  with  other  navaid  frequencies?  If  yes, 
please  comment. 

(  )  Yes  (  )  No 


3.  Is  a  major  change  in  approach  chart  format  warranted  or  desirable?  If  yes,  please  comments. 
(  )  Yes  (  )  No 


Please  answer  the  following  two  questions  only  if  you  have  any  experience  flying  nonprecision  loran 
approaches. 

1.  Have  you  flown  loran  approaches  as  part  of  recreational  flying? 


2.  What  are  the  problems,  if  any,  that  you  have  experienced  while  flying  these  approaches? 
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C.  Factors  Affecting  Chart  Clutter 

Chart  clutter  can  degrade  pilot  performance  by  detracting  from  his/her  ability  to  extract  relevant 
information  from  the  lAP  to  perform  an  instrument  approach  procedure. 

The  following  represents  a  nonexhaustive  list  of  categories  of  information  that  can  contribute  to 
approach  chart  clutter. 

7.  Chart  Identification  Information  6.  Missed  Approach  Information 

2.  Airport  Identification  7.  Communication  Frequencies 

3.  Terrain  Information  8.  Minimum  altitudes 

4.  Navigation  Waypoints  9.  Airport  Notes 

5.  Routing  Procedures 

An  example  from  each  of  these  categories  (if  applicable)  is  shown  on  the  following  page  (Figure 
1).  Each  sample  lAP  contained  throughout  this  document  has  been  reduced  to  95%  of  its  original  size. 

.  THESE  CHARTS  HAVE  BEEN  REPRODUCED  FOR  ILLUSTRATIVE  PURPOSES  ONLY 
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mm  rom  na  vigathon 

Information  Categories  Contributing  to  Chart  Clutter 


JEPPESEM 


SEP 


Communication 

Frequencies 


ATiS  Arrival  115.7  Soulh  Arrival  154.82 
I  NEW  YORK  Approach  IR'  128.55 
NEWARK  Tower  118.3 
Ground  121.8 

1  Helicopter  &  Seaplane  127.85 


13-91  (16-2)  ■Jie'Mil 


NEWARK,  NJ 

NEWARK  INTL 

NDB  Rwy  4R 

LOM  204  EZ 

Apt.  Blev  1 8 


I-  40-50 

Terrain  Information 


Navigation 

Waypoints 


Routing 

Procedures 


«8  A 


Missed  - 
Approach 
Information 


/6v 


GRITY  ‘■2^ 

3000' 1-039%. 1700' ill  n. 

2988'!  \  - - -  . 

■  ^ 

1 

TO  1  tU  tdze12 

ni^PiACED  1  6.2  1 _ _ _  _ _ 

threshold  1 1.1 

"  MISSED  APPROACH:  Climb  to  2000’  then  climbing  LEFT 
via  STW  VOR  R- 121  to  MORNS  INT  and  hold. 

01  APT. !« 

turn  to  3000'  inbound 

STRAIGHT  IN  landing  RWY  4R 

nupA  p*  620  '606 

Max 

CIRCLE-TO-LANU 

A 

6 

»V»40orV.  ‘  BVsSOorl 

90 

120 

660'i6.<?'i-  1 

C 

»V»60orV/4 

140 

660'f6<?V- 1 

D 

i  2 

165 

920'f902'j-3 

“g 

'xj  ip»*d  Hft  70 

90  1  WO  :  \20 

/40 

\b0 

- - - 1 - 

• 

lOiM  to  MAP  4  9  1  4;  12 

3:16  2:56|2:27 

2;06 

l:b0 

FIGURE  I. 


Chart 

Identification 


Minimum 

Altitudes 
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Using  the  scale  provided,  please  indicate  how  much  each  category  contributes  to  chart  clutter. 


1. 

Chart  Identification  Info 

I 

2 

3 

4 

5 

No 

Significant 

clutter 

clutter 

2. 

Airport  Information 

1 

2 

3 

4 

5 

No 

Significant 

clutter 

clutter 

3. 

Terrain  Information 

1 

2 

3 

4 

5 

No 

Significant 

clutter 

clutter 

4. 

Navigation  Waypoints 

1 

2 

3 

4 

5 

No 

Significant 

clutter 

clutter 

5. 

Routing  Procedures 

1 

2 

3 

4 

5 

No 

Significant 

clutter 

clutter 

6. 

Missed  Approach 

1 

2 

3 

4 

5 

Information 

No 

Significant 

clutter 

clutter 

7. 

Communication 

1 

2 

3 

4 

5 

Frequencies 

No 

Significant 

clutter 

clutter 

8. 

Minimum  Altitudes 

1 

2 

3 

4 

5 

No 

Significant 

clutter 

clutter 

B-10 


Please  comment  on  how  you  might  like  to  reduce  approach  chart  clutter. 


More  on  Avoroach  Chart  Clutter 

1.  Would  you  like  to  see  the  level  of  terrain  information  on  the  lAP  increased  or  decreased?  Please 
comment. 

(  )  Increased  (  )  Decreased 


2.  Trade-offs  exist  between  the  presentation  of  terrain  information  and  chart  clutter.  HOW  should  terrain 
information  be  presented?  Some  possibilities  are  the  depiction  of  “spot  elevations,”  i.e.,  height  of 
communication  towers,  prominent  terrain  features,  or  the  depiction  of  terrain  contours  in  color.  Please 
comment. 


D.  Operator  Preferences 

1 .  Do  you  use  the  TAP  while  landing  in  VFR  conditions? 

(  )  Yes  (  )  No 

2.  How  do  you  use  an  lAP  differently,  if  at  all,  if  you  are  familiar/unfamiliar  with  the  airport? 


3.  Does  your  company  require  you  to  brief  an  instrument  approach  procedure  in  a  specified  manner? 

(  )  Yes  (  )  No 

4.  If  not,  do  you  brief  an  instrument  approach  procedure  the  way  you  were  initially  trained? 

(  )  Yes  (  )  No 

5.  Procedurally,  do  you  brief  a  precision  and  nonprecision  approach  procedure  in  the  same  manner? 

(  )  Yes  (  )  No 

The  following  page  (Figure  II)  contains  a  sample  Jeppeson-Sanderson  lAP.  Please  highlight  in 
yellow  the  information  you  normally  include  in  your  approach  brief,  if  applicable. 
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N(Q)T  IFOE  NAVIGATIION 

Information  Content  of  Your  Instrument  Approach  Brief 


JEPPESEIN] _ SEP  15-91  (16-2. 

AXIS  Arrival  115.7  Sooth  Arrival  134.82 
NEW  YORK  Approach  (R)  128.55 
NEWARK  Tower  118.3 

Ground  121.8 

Helicopter  &  Seaplane  127.85 


/  2800'  \ 

Uo  1700'/ 

\2I00'  '  / 

V  %  y  MSA 

^ - ez  LOM 


NEWARK,  NJ 

NEWARK  INTL 

NDB  Rwy  4R 

LOM  204  EZ 


Apt.  Elev  1  8 ' 


CMANOfi  Arrival  fraqwaocy,  Morm  Inf  (ormalic 


(g)  JEPRESEN  SANDERSON.  INC.,  1987.  1991.  AIL  RIGHTS  RESERVED 


FIGURE  II. 
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III.  APPROACH  PLATE  INFORMATION  ANALYSIS 


A.  Purpose 

Depending  on  company  training  policy  and/or  aviation  background,  pilots/flight  crews  may  group, 
and  subsequently  utilize,  the  information  contained  on  an  lAP  differently.  We  would  like  to  determine 
the  instrument  approach  information  that  pilots  would  prefer  to  have  available  to  them  as  it  pertains  to 
phase  of  flight. 

Individuals  within  the  Aeronautical  Systems  Laboratory  have  subjectively  divided  an  instrument 
approach  procedure  into  four  phases  of  flight.  It  should  be  noted  here  that  the  phases  of  flight  remain 
constant  for  both  precision  and  nonprecision  approaches.  They  are  as  follows: 

1.  Pre-Approach  (Prior  to  arrival  in  the  terminal  area) 

2.  Approach  (Execution  of  the  approach  procedure) 

3.  Missed  Approach  (If  required) 

4.  Ground  Operations  (Taxi  for  take-off,  taxi  to  parking) 

Assume  IFR  conditions,  and  flight  operations  conducted  in  a  radar  controlled  environment. 

B.  Procedure 

On  each  of  the  following  pages  (Figures  III-IX),  sample  Jeppeson-Sanderson  precision  and 
nonprecision  approach  plates  are  provided  for  each  of  the  four  instrument  approach  phases  of  flight. 

a.  ILS  13R  at  Kennedy 

You  will  be  approaching  from  the  north  and  can  expect  to  receive  vectors  to  intercept  the 

localizer. 

B.  NDB  4R  to  Newark 

You  will  be  approaching  from  the  south  and  have  been  told  to  expect  your  own  navigation 
direct  to  “Grity”. 

C.  Directions 

Please  evaluate  the  information  content  of  both  the  precision  and  nonprecision  lAP  as  it  pertains 
to  phase  of  flight  in  the  following  manner. 

•  Using  the  yellow  highlighter,  indicate  the  information  you  feel  is  critical  to  have  access 
to  during  the  given  phase  of  flight.  For  example,  if  you  feel  that  it  is  critical  to  have  missed  approach 
information  available  to  you  during  the  pre-approach  phase  of  flight,  highlight  this  information. 

•  Using  the  pink  highlighter,  highlight  the  information  you  would  suppress  if  you  had  the 
opportunity  to  customize  the  lAP  for  this  particular  phase  of  flight. 

•  Please  note  that  each  piece  of  information  contained  on  the  plate  does  not  have  to  be 

highlighted. 
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FIGURE  III. 
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NOT  IF«  NA  YIKGATffiDN 


Phase  I:  Pre-Approach  (Prior  to  entering  the  terminal  area) 
B.  Non-Precision  Approach 
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B.  Non-Precision  Approach 
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Phase  ni:  Missed  Approach 
A.  Precision  Approach 


JEPPESErVi  may  25-90  * 

ATIS  Arrival  1  28.72  (NE)  117.7  {SW)115.4 

NEW  YORK  Approach  (R)  127.4 
KENNEDY  Towar  119.1 
Ground  121.9 


n-3)  ■jW.CTMl 


/  MSA 
JFK  VOR 


NEW  YORK,  NY 

KENNEDY  INTL 

ILS  Rwy  13L 

LOC  111.5  ITLK 


Apt.  Elev  1  3 


^  Tetarboro 


pLA  GUAROIA— I 

lullS.l  LGA 


TELEX 

D7.  7  ITLK  ILS 

PONEY  ^ 

D6.  I  ITLK  ILS 

0-40 

OME  distance  from  ITLK  DME 
to  1522'  building  NW  of  apt.,  • 
12.3  NM  4  1742' building  | 
WNW  of  apt.,  12.5  NM.  I 

r''^  693'  'v 


101 '  Kangar  abeam  rwy  threshold  \ 
850’  left  of  rwy  centerlirsa.  \. 

Vahicle  overpass  670'  ri^t  on  rwy 
contorlina  IM'  from  dttplacod  throahold 
•xtonding  450'  pvailal  to  rwy. 


Radar  required 

TELEX 

07.  7  ITLK  ILS 
GS 20007/987- 

2000' 


_ ILS  ome _ 

133°  111.5  ITLK 


DI.7 
yITLK  ILS 


181115(9  JFK 


D<S.  I  ITLK  US 
CS  1476'fUlSJ'; 

I  TCH  at  displaced 

I  threshold  54'. 

_ !  1.6  t  TDZE  15' _ 

APT.  13' 

MISSED  AfffOACH:  Climb  to  500'  then  climbing  LEFT  turn  to  4000'  outbound 
via  JFK  VOR  R-078  to  DPK  VOR  and  hold. 


D1.7 
ITLK  ILS 
MM  I 


STRAIGHT. IN  LANDING  RWY  131 

ILS  I  LOC  ICS  out) 

DAiK,  2 1 3'f200';  I  OAiHi  26Z'i250'i  I  uoaihi  600'f5fl7'; 


inTREdni 


RvR  1 8  *v«  24  itvil  40 

or  Vl  O’  '/2  Of  Y. 


RVIl  24  or  y? 


«VR  40  or  94 


RVR24or'/2 

RVR  50orl 

RVR  50orl 

IY2 

taSSJSTSMSnKKKm^MMEat^WZEMWniMl 
IWWMBlWqlTWlsg  t.lHC?.lM»;ll>aMlB.t.Hgg 


CHANOCS-  PIMWIO.  r>l.s,  T.I.x  Inl  fofm.tion.  TCH.  O  JfWtStN  SANOfRSON,  INC..  1986.  1990.  AU  RIGHTS  RtSERVtD. 

FIGURE  VII. 


B-18 


WN  S 


NOT  IFOM  NA  VIOATIION 


Phase  III:  Missed  Approach 
B.  Non-  Precision  Approach 


FIGURE  VIIL 
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NOT  IFOM  NAVIGATIION 

Phase  rV:  Ground  Operations 


FIGURE  IX. 
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IV.  ELECTRONIC  APPROACH  CHARTS 


A.  Purpose 

Replication  of  paper  approach  plates  in  electronic  format  may  limit  the  amount  of  approach 
information  available  to  the  pilot  due  to  limitations  in  display  technology.  However,  electronic  approach 
plates  may  also  provide  the  pilot  with  the  flexibility  to  select  only  desired  approach  information. 

The  following  questions  seek  to  determine  your  preferences  regarding  some  of  the  options 
currently  available  for  electronic  replication  of  approach  plates,  given  the  available  technology. 

1.  Would  you  favor  the  replication  of  paper  instrument  approach  plates  in  electronic  format? 

(  )  Yes  (  )  No 

2.  Would  you  feel  comfortable  using  solely  electronic  plates  with  no  paper  approach  plates  available  as 
a  back-up? 


3.  Two  prototype  designs  for  electronic  approach  plates  are  static  and  dynamic.  The  static  plate  is  a 
replication  of  the  paper  chart  with  a  north-up  orientation,  while  the  dynamic  chart  has  a  moving  map 
platform  view  similar  to  the  EHSI  and  a  track-up  orientation.  Which  would  you  prefer  and  why? 


For  the  following  three  questions,  "customizing"  an  approach  plate  refers  to  being  able  to  select  or 
deselect  approach  information  of  your  choice  in  an  attempt  to  have  a  “cleaner”  presentation  with  reduced 
chart  clutter.  Selection  of  information  could  be  accomplished  prior  to  departure;  however ,  all  information 
would  be  constantly  accessible  to  you  at  any  time  you  desire  to  select  it.  Also,  in  the  event  of  a  missed 
approach,  missed  approach  information  will  automatically  be  displayed. 

4.  Would  you  find  it  desirable  to  be  able  to  customerize  your  approach  plate?  Why? 

(  )Yes  (  )No 


5.  Would  this  procedure  cause  a  significant  workload  increase  during  the  approach  phase  of  flight?  How? 


(  )Yes 


(  )No 


6.  Would  you  require  the  same  information  display  if  you  were  hand  flying  the  approach  as  opposed  to 
performing  an  autoflight  approach?  If  yes,  how? 

(  )  Yes  (  )  No 

7.  Would  a  moving  map  display  of  the  airport  be  useful  while  taxiing  to  the  gate? 

(  )  Yes  (  )  No 

CONCLUSION 

The  information  you  have  provided  will  be  extremely  useful  in  our  research.  Your  participation 
in  this  survey  is  greatly  appreciated. 

Please  keep  the  highlighters,  and  return  the  survey  to  us  as  soon  as  possible;  preferably  within  one 
week  of  receipt.  Thank  you  again  for  your  participation! 


Appendix  C 


Question  List  for  Operator  Interviews 


What  type  of  approach  charts,  SID’s  and  STAR’S  does  your  organization  use? 


What  are  the  best  features  of  the  charts? 


What  are  the  worst  features  of  the  charts? 


Describe  how  you  teach  the  use  of  approach  charts.  (What  is  company  policy?) 


What  do  you  include  in  your  pre-approach  briefing? 


Have  you  observed  or  heard  of  operational  errors  which  could  be  related  to  the  design  of  current 
charts? 


Are  the  current  charts: 

Lacking  information 

Cluttered 

Optimal 


Do  you  feel  that  more  terrain  information  should  be  included  in  the  charts?  (Why,  Where) 


Are  there  any  procedures  or  operations  relating  to  the  interpretation  of  approach  chart  information 
which  students  find  particularly  difficult? 


In  terms  of  presentation,  what  would  you  like  to  change  about  the  charts  you  are  currently  using? 
Please  be  specific. 
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Under  what  conditions  do  you  use  the  charts  when  you  are  out  of  the  airplane? 


How  difficult  is  it  to  keep  your  plates  current? 

How  current  is  the  plate  information? 

Are  NOTAMS  dealt  with  satisfactorily  with  the  charts  you  are  using?  How  do  you  check  for 
the  latest  NOTAMS? 

Do  you  teach  the  use  of  approach  plates  on  visual  appearances?  (What  info?) 

Have  you  had  any  experience  with  CD  ROM  systems  such  as  “Lasertrack”  which  print  on  paper 
in  the  cockpit? 


What  differences  in  approach  plate  usage  is  familiar  versus  unfamiliar  airport? 


What  physical  considerations  are  important  to  use  of  charts?  (lighting,  size,  print...) 


How  do  you  feel  that  advanced  approach  chart  formats  should  be  evaluate? 


What  do  you  feel  are  the  advantages,  disadvantages  and  potential  hazards  associated  with  the 
presentation  of  approach  information  in  electronic  (EFIS  like)  format? 


On  autoflight  equipped  aircraft  is  it  possible  to  make  a  safe  approaeh  in  IMC  without  paper 
approach  plates?  Why?  Have  you  heard  of  instances  of  this  occurring? 

What  do  you  think  about  the  reliability  of  electronically  based  systems  for  approaeh  information? 


General  comments. 
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